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TITLE OF THR INVENTION 

Methods and Apparatus for Transforming 
Three-dimensional Objects in Video Games 
BACKGROUND OF ru r, invention 
Field of the Inventinn 

The present invention relates to computer 
graphics ( cq, and, more specifically, to a technic^ 
for transforming a three-dimensional object in a 
virtual three-dimensional spaC e. 
Related Back ground Art 

I» CO, a technique called cluster transf ormation 
in general has been ktBn as a technique for 
transforms, a three-dimensional object whose form is 
determined by a plurality of vortexes, in order to 
express its fine actions and the lifce, . In the clnster 
transformation, vert.xea of , three-dimensional 
object are grouped into a plurality of groups, and each 
group forms a cluster. i„ sach cluster , th= 
belonging thereto are moved, so as to transform the 
three-dimensional object. E ach vertex can belong to 
a Plurality of clusters. Mso, , Maight .„ be ^ 
for the vortexes belonging to each cluster, 
consequently . very fine transformations can be carried 
out as well. 

The cluster transformation can effectively be 
utilized for transforming objects in video games as 
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well, if the cluster transformation is employed for 
minutely deforming characters in a game, then it 
becomes easier to express them realistically. 

Japanese Patent Application Laid-open No. HEI 
10-188028 has been known as an example in which the 
cluster transformation is applied to a video game . Ja 
the technique disclosed in this publication, for a 
three-dimensional object whose framework is defined 
by skeletons, joints and skeletons are also imparted 
to constituent parts lacking joints and bones in 
reality. 

in the abov e _ me ntioned publication, a number of 
polygons constituting a three-dimensional object 
accompany a skeleton. . * number of polygons 
accompanying a skeleton are controlled so as to rotate 
when the skeleton rotates. As a consequence, parts 
lacking joints andbones canbe caused to perform minute 
movements, ror example, in a three-dimensional 
object representing a human face, a polygon 
representing an eyelid is made to accompany a skeleton, 
and this skeleton is rotated. Hence, the 
three-dimensional object can be transformed such that 
the eyelid opens and closes. 

However, a vertex rotating operation 
necessitates a greater use of matrix operations. 
Therefore, if there are a greater number of expression 
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parts involving a minute transformation on a screen, 
then the load for processing them increases. 
Currently, there is a demand for a procedure which 
realizes a similar display mode while reducing the 
5 processing load. 

5UMMARY OF THE INVENTION 

Therefore, it is an object of the present 
invention to provide a technique which realizes fine 
transformations of three-dimensional objects by a 
10 simple process. 

The three-dimensional object transforming method in 
a video game for transforming a three-dimensional 
object having a form at least a part of which is 
determined by a plurality of vertexes associated with 

15 a cluster, in accordance with a first aspect of the 

present invention, includes acquiring, in each frame 
display period, an amount of parallel movement of the 
cluster according to animation data defining a movement 
of the three-dimensional object; and calculating, 

ZO according to this acquired amount of parallel movement 

of the cluster and a weight predefined for each vertex 
corresponding to the cluster, an amount of parallel 
movement of each vertex and moving, according to this 
calculated amount of parallel movement, the vertexes 

25 parallel to each other in each frame display period. 

Since only parallel movement is permitted with 
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respect to the movement of vertexes belonging to a 
cluster, it becomes unnecessary to take account of 
transforming operations, and multiplication and 
addition would suffice without necessitating matrix 
operations. Namely, the amount of processing is 
reduced as a whole. Consequently, fine 
transformations of three-dimensional objects can be 
processed in real time. 

Also , themethod can be configured so as to further 
include moving, according to a movement of a joint in 
a virtual skeleton defining a framework of the 
three-dimensional object and including a plurality of 
joints, each of the plurality of vertexes being 
associated with at least one of the plurality of joints , 
the vertex corresponding thereto after the 
above-mentioned parallel movement of the vertexes. 

If the movement of the corresponding vertex is 
introduced as mentioned above, a greater 
transformation wili be performed after fine 
transformations of the three-dimensional object are 
carried out. As a consequence, the whole processing 
becomes simpler. For example, in the case of opening 
the mouth of a three-dimensional object of a human model 
and bending its neck in the configuration mentioned 
above , the neckwouldbe bent after the lower lip portion 
is moved directly downward. Thus, the operation of 
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opening the mouth and the operation of moving the lower 
Up portion directly downward correspond to each other 
one to one . In a configuration where the movement of 
the corresponding vertex is carried out before the 
parallel movement of the vertexes, however, the mouth 
would open after the neck is bent, when the neck is 
bent, the mouth will not open in a natural form even 
if the lower lip portion is moved directly downward. 

Hence, the lower lip portion has to bemoved while taking 
account of how the neck bends. 

Also, the method can be configured such that the 
above-mentioned acquisition of the amount of parallel 
movement of the cluster includes determining whether 
an amount of parallel movement of each cluster in a 
frame display period being processed is defined or not ; 
calculating, if it is determined that the amount of 
parallel movement of each cluster in the frame display 
period being processed is not defined, the amount of 
parallel movement of each cluster in the frame display 
period being processed according to an amount of 
parallel movement of each cluster in a frame display 
period having already been processed and an amount of 
parallel movement of each cluster in a frame display 
period to be processed later; and acquiring, if it is 
determined that the amount of parallel movement of each 
cluster in the frame display period being processed 
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is defined, the defined amount of parallel movement 
of each cluster in the frame display period being 
processed . 

A program for causing a computer to execute the 
three-dimensional object transforming method in a 
video game in accordance with the first aspect of the 
present invention can be made, in this case, 
modifications such as those mentioned above with 
respect to the first aspect are also applicable to the 
program. The program in accordance with the present 
invention is stored in a recording medium or storage 
device, for example, such as CD-ROM (Compact Disc-Read 
Only Memory), dvd (Digital Versatile Disc), floppy disk, 
memory cartridge, memory, hard disk, or the like, when 
the program stored in a recording medium or storage 
device is read by the computer, a video game apparatus 
which will be explained in the following can be realized. 
Also, by means of a recording medium, the program in 
accordance with the present invention can easily be 
distributed and sold as a software product 
independently from apparatus. Further, if the 
program in accordance with the present invention is 
executed by use of hardware such as a computer, the 
technique of the present invention can easily be 
realized with hardware such as a computer. 

In accordance with a second aspect of the present 
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invention, the video game apparatus, which comprises 
a computer- readable storage medium storing a program 
for a video game which transforms a three-dimensional 
object having a form at least a part of which is 
determined by a plurality of vertexes associated with 
a cluster, and a computer which reads out at least one 
of said programs from the computer- readable storage 
medium to perform, by executing the read-out program , 
b acquiring, in each frame display period, an amount 
of parallel movement of the cluster according to 
animation data defining a movement of the 
three-dimensional object; and calculating, according 
to the amount of parallel movement of the cluster 
acquired in the acquiring and a weight predefined for 
each vertex corresponding to the cluster, an amount 
of parallel movement of each vertex and moving, 
according to thus calculated amount of parallel 
movement, the vertexes parallel to each other in each 
frame display period. 

The video game apparatus in accordance with a 
third aspect of the present invention has a computer ; 
and a computer-readable recording medium having 
recorded therein a program to be executed by the 
computer . The program causes the computer to perform 
an acguiring , in each frame display period, an amount 
of parallel movement of each cluster according to 
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animation data defining a movement of the 
three-dimensional object; and calculating, 
according to the amount of parallel movement of the 
cluster acquired by the acquiring process and a wejLgnt 
5 predefined for each vertex corresponding to the cluster , . 

an amount of parallel movement of each vertex and mov ing , 
according to thus calculated amount of parallel 
movement, the vertexes parallel to each other in each 
frame display period. 

10 The present invention will become more fully 

understood from the detailed description given 
hereinbelow and the accompanying drawings which are 
given byway of illustration only, and thus are not 
to be considered as limiting the present invention. 

Further scope of applicability of the present 
invention will become apparent from the detailed 
description given hereinafter. However, it should be 
understood that the detailed description and specific 
examples, while indicating preferred embodiments of 
the invention, are given by way of illustration only, 
since various changes and modifications within the 
spirit and scope of the invention win become apparent 
to those skilled in the art from this detailed 
description. 

BRIEF DESCRIP TION! OF THE DRAWINGS 

Fig. 1 shows a block diagram of a home game 
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machine; 

Fig . 2 shows a chart showing an example of a vertex 
coordinate list; 

Fig. 3 shows a chart showing an example of a normal 
5 vector list; 

Fig. 4 shows a chart showing an example of a 
triangular polygon list; 

Fig . 5 shows a chart showing an example of a vertex 
group list; 

10 Fig. 6 shows a chart showing an example of cluster 

data; 

Fig. 7A and B show charts showing examples of 
animation data; 

Fig. 8A is a schematic view showing a state before 
15 a cluster transformation; 

Fig. 8B is a schematic view showing a state where 
the cluster transformation is carried out while the 
weight of all the vertexes belonging to the cluster 
C is set to 100%; 
20 Fig, 8C is a schematic view showing a state where 

the cluster transformation is carried out by use of 
the present invention; 

Fig. 9 shows a flowchart showing a main flow of 
the processing in accordance with the present 
26 invention - 

Fig. 10 shows a flowchart of the 
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three-dimensional object transforming process in 
accordance with the present invention; 

Pig. 11 shows a flowchart of the cluster 
transforming process in accordance with the present 
invention; 

Fig. 12 is a view showing a polygon model of a 
three-dimensional object in a state before a 
transformation; 

Pig. 13 is a view showing the polygon model of 
a three-dimensional object in a state after the 
transformation; 

Pig. 14 shows an example of a display screen of 
the three-dimensional object shown in Fig. 12; and 

Fig. 15 shows an example of a display screen of 
the three-dimensional object shown in Fig. 13. 
DESCRIPTION OF THE PREFERRED EMBODIMENTS 

Fig. 1 shows an example of home game machine loi 
which executes a computer program in the case where 
the present invention is carried out by the computer 
program. The home game machine 101 comprises, for 
example, a CPU (Central Processing Unit) 103, a ROM 
(Read only Memory) 104, a RAM (Random Access Memory ) 
105, an HDD (Hard Disk Drive) 107, a sound processing 
unit 109, a graphics processing unit ill, aCD-ROMdrive 
113, a communications interface 115, and an interface 
unit 117 which are connected to an internal bus 119. 
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The graphics processing unit 111 is equipped with a 
frame buffer 112 - 

The sound processing unit 109 and graphics 
processing unit 111 of the home game machine 101 are 
5 connected to a TV set 121 having a display screen 120 . 

A removable CD-ROM 13 1 is inserted into the CD-ROM drive 
113, A game program. 133 and data 135 in accordance 
with the present invention are recorded on the CD-ROM 
131. The communications interface 115 is connected 
10 to a network 151 via a communications medium 141- A 

keypad 161 equipped with operation buttons and a memory 
card 171 are connected to the interface unit 117. 

The CPU 103 executes a program stored in the ROM 
10 4 and the game program 133 recorded on the CD-ROM 
15 131, thereby controlling the home game machine 101. 

The RAM 105 is a work area for the CPU 103. The HDD 
107 is a storage area for keeping the game program 133 
and data 135 recorded on the CD-ROM 131, for example. 
The memory card 171 is a storage area for saving data 
20 which the game program 133 refers to - In the case where 
the program executed by the CPU 103 commands that sounds 
be outputted, the sound processing unit 109 interprets 
this command and outputs a sound signal to the TV set 
121. 

25 According to a drawing instruction outputted from 

the CPU 103 , the graphics processing unit 111 generates 
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image data and writes this generated data into the frame 
buffer 112. Then, to the TV set 121, the graphics 
processing unit 111 outputs a signal for displaying 
this written image data onto the display screen 12 0. 
5 The CD-ROM drive 113 reads out the game program 133 

and data 135 on the CD-ROM 131. The communications 
interface 115 is connected to the network 151 via the 
communications medium 141, and controls the 
input/output of data communications carried out with 
10 other computers and the like. The interface unit 117 

outputs the input from the keypad 161 into the RAM 105 , 
whereas the CPU 103 interprets the input from the keypad 
161 and carries out arithmetic operations. 

The game program 133 and data 135 in accordance 
15 with the present invention are initially recorded on 

the CD-ROM 131 , for example. Upon execution, the game 
program 133 and data 135 are read out by the CD-ROM 
drive 113 and are loaded into the RAM 105. The data 
135 loaded into the RAM 105 includes, as shown in Fig. 
20 1, a vertex coordinate list 200 , a normal vector list 

300, a triangular polygon list 400, cluster data 600 r 
and animation data 700. Also, data employed during 
the processing of the program in accordance with the 
present invention includes a vertex buffer 800 and a 
25 frame counter 900, They will be explained in detail 

in the following. The game program 133 and data 135 
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in accordance with the present invention recorded on 
the CD-ROM 131 may be read out by the CD-ROM drive 113 
beforehand and stored in the HDD 107 . In the case where 
the game program 133 and data 135 in accordance with 
5 the present invention are stored in the HDD 107, the 

game program 133 and data 135 are loaded into the ram 
105 from the HDD 107. 

In accordance with the present invention the CPU 
103 processes the game program 133 and data 135 in 
10 accordance with the present invention loaded in the 

RAM 105, and outputs a drawing instruction to the 
graphics processing unit 111. Here r intermediate 
data are loaded into the RAM 105 for storage- The 
graphics processing unit 111 carries out processing 
15 operations according to the drawing instruction from 

the CPU 103 , writes image data into the frame buffer 
112, and outputs to the TV set 121 a signal for 
displaying the image data onto the display screen 12 0 . 
Algorithms of the program in accordance with the 
20 present invention executed in the foregoing home game 

machine 101 and data employed therein will now be 
explained in detail. 

Figs . 2/ 3 , 4 r 5 f 6 and 7 explain the data employed 
in the present invention. 
25 Fig- 2 shows the vertex coordinate list 200 

concerning vertexes of a three-dimensional object in 
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the case where the three-dimensional object is 
constituted by triangular polygons- The vertex 
coordinate list 200 includes a column 210 for vertex 
coordinate indexes (index) and a column 220 for 
5 coordinates (x, y, z). 

In Fig. 2, the vertex of vertex index vtxO has 
coordinates of ( -8 , 1 , -2 ) > The vertex of vertex index 
vtxl has coordinates of (-5, 4, 2). The vertex of 
vertex index vtx2 has coordinates of (-5, 0, 0) . The 
10 vertex of vertex index vtx3 has coordinates of (5, 6, 

0) . The vertex of vertex index vtx4 has coordinates 
of (5, 4, 2). The vertex of 'vertex index vtxS has 
coordinates of (8, 1, -2). The vertex coordinates in 
the vertex coordinate list 200 are relative positional 
15. coordinates from a predetermined reference position. 

Fig. 3 shows the normal vector list 300. The 
normal vector list 300 is a list for defining the normal 
vector at each vertex of triangular polygons. The 
normal vector list 300 includes a column 310 for normal 
20 vector indexes (index) and a column 320 for normal 

vectors (x r y, z) . 

In Fig- 3, the normal vector of normal vector 
index nmlO is (1/ 0, 0) - The normal vector of normal 
vector index nmll is (-1, 0, 0). The normal vector 
25 of normal vector index nml2 is (0, 0, -1) . The normal 

vector of normal vector index nml3 is ( -1 , -1 , 0 ) . The 
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normal vector of normal vector index nml4 is (0, -1, 
0). 

Fig. 4 shows the triangular polygon list 400. 
The triangular polygon list 400 stores the vertex 

5 indexes and normal vector indexes of vertexes 0, 1 and 

2 constituting each triangular polygon- The 
triangular polygon list 400 includes a column 410 for 
triangular polygon indexes (index), a column 42 0 
concerning vertex 0 for the vertex index of the vertex 

10 constituting vertex 0 and the normal vector index of 

the normal vector thereof , a column 430 concerning 
vertex 1 for the vertex index of the vertex constituting 
vertex 1 and the normal vector index of the normal vector 
thereof , and a column 440 concerning vertex 2 for the 

15 vertex index of the vertex constituting vertex 2 and 

the normal vector index of the normal vector thereof. 

In Fig. 4, the vertex 0 of the triangular polygon 
of triangular polygon index plgO is constituted by the 
vertex of vertex index vtxQ and the normal vector of 

20 normal vector index nmlO. The vertex 1 of the 

triangular polygon of triangular polygon index plgO 
is constituted by the vertex of vertex index vtxl and 
the normal vector of normal vector index nml2. The 
vertex 2 of the triangular polygon of triangular 

25 polygon index plgO is constituted by the vertex of 

vertex index vtx2 and the normal vector of normal vector 
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The vertex 0 of the triangular polygon of 
triangular polygon index plgl is constituted by the 
vertex of vertex index vtxO and the normal vector of 
5 normal vector index nmll- The vertex 1 of the 

triangular polygon of triangular polygon index plgl 
is constituted by the vertex of vertex index vtx2 and 
the normal vector of normal vector index nml3. The 
vertex 2 of the triangular polygon of triangular 
10 polygon index plgl is constituted by the vertex of 

vertex index vtx3 and the normal vector of normal vector 
index nml4. 

When the vertex coordinate list 200 and the normal 
vector list 300 are provided, while "the triangular 
15 polygon list 400 storing the vertex index and normal 

vector index is prepared separately, data of identical 
vertex coordinates and data of identic al normal vectors 
can commonly be used in the triangular polygon list 
400. Also, with respect to the same vertex, normal 
20 vectors separately may be defined fox every polygon. 

Vertexes defining thef ormof a three-dimensional 
object are grouped. Here, each vertex may belong to 
a plurality of groups- Fig. 5 shows the vertex group 
list 500 . The vertex group list 500 stores the number 
25 of vertex groups? and, for each vertex group , thenumber 

of vertexes belonging to the vertex group, each vertex 
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index of the vertexes belonging to the vertex group, 
and the weight predefined for each vertex. Hence , the 
vertex group list 500 is provided with a column 510 
for the number of groups, columns 520 , 522 and 524 for 
5 the numbers of vertexes, columns 530, 532, 534, 536/ 

538, 539, 550, 552 and 554 for vertex indexes, and 
columns 540, 542, 544, 546, 548, 549, 560, 562 and 564 
for the weights of vertexes. Data for a new vertex 
group begins from a new column for the number of 
10 vertexes. 

In Fig. 5, the group number column 510 indicates 
that the number of groups is 3 . The vertex number 
column 520 fpr the vertex group 0 indicates that the 
number of vertexes in the vertex group 0 is 6. The 
15 vertex index column 530 for a vertex belonging to the 

vertex group 0 stores vertex index vtxO . The weight 
column 540 corresponding to the vertex index vtxO 
stores a weight of 0.5. The vertex index column 532 
for a vertex belonging to the vertex group 0 stores 
20 vertex index vtxl. The weight column 542 

corresponding to the vertex index vtxl stores a weight 
of 1.0. 

The vertex index column 534 for a vertexbelonging 
to the vertex group 0 stores vertex index vtx2 . The 
25 weight column 544 corresponding to the vertex index 

vtx2 stores a weight of 1.0. The vertex index column 



17 



MRY-30-2002 12:02 BEYER LIEAUER & THOMAS "650 961 8301 P. 29/71 



F?»0103-00 



536 fox a vertex belonging to the vertex group 0 stores 
vertex, index vtx3 . The weight column 546 
corresponding to the vertex index vtx3 stores a weight 
of 1-0. The vertex index column 538 for a vertex 
5 belonging to the vertex group 0 stores vertex index 

vtx4. The weight column 548 corresponding to the 
vertex index vtx4 stores a weight of 1.0. The vertex 
index column 539 for a vertex belonging to the vertex 
group o stores vertex index vtx5 . The weight column 
10 549 corresponding to the vertex index vtx5 stores a 

weight of 0.5. 

The vertex number column 522 for the vertex group 

1 indicates that the number of vertexes in the vertex 
group 1 is 2. The vertex index column 55 0 for a vertex 

15 belonging to the vertex group 1 stores vertex index 

vtx4 - The weight column 560 corresponding to the 
vertex index vtx4 stores a weight of 0.3. The vertex 
index column 552 for a vertex belonging to the vertex 
group 1 stores vertex index vtxS. The weight column 

20 562 corresponding to the vertex index vtx6 stores a 

weight of 0,2. 

The vertex number column 524 for the vertex group 

2 indicates that the number of vertexes in the vertex 
group 2 is 1. The vertex index column 554 for the vertex 

25 belonging to the vertex group 2 stores vertex index 

vtx7. The weight column 564 corresponding to the 
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vertex index vtx7 stores a weight of 0-5. In this 
embodiment , each weight is a real number of at least 
0 but not greater than 1. 

In this embodiment, transformation is carried 
5 out for each cluster. Fig. 6 shows the cluster data 

60 0 „ The cluster data 6 00 includes a reference amount 
of parallel movement for each cluster and information 
concerning vertex groups included in the cluster. 
Here/ there may exist a vertex group included in a 
10 plurality of clusters. The cluster number column 610 

stores the number of clusters included in the cluster 
data 600 . It is 2 in the example of Fig. 6, 

& cluster index (index) column 620 stores the 
index of a cluster included in the cluster data 600 . 
15 It is cluster clustO in the example of Fig. 6. The 

column 622 for the reference amount of parallel 
movement (x, y, z) of the cluster clustO stores a 
reference amount of parallel movement (0, 0, 0). The 
column 624 for the number of vertex groups belonging 
20 to the cluster clustO stores the number of vertex groups 

belonging to the cluster clustO, i.e,, 2, in the vertex 
groups included in the vertex group list 500, 
Specifically, vertex group ID columns 626 and 628 for 
vertex groups belonging to the cluster clustO store 
25 the vertex group IDs 3 and 2, respectively . 

Prom a column 630 for a new cluster index ( index) 

19 
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to the next cluster index column, an area for storing 
data for a new cluster is formed- The cluster index 
column 6 30 stores cluster index clustl- The column 
632 for the reference amount of parallel movement (x, 
5 y, z) of the cluster clustl stores a reference amount 

of parallel movement (0, 0, 0), The column 634 for 
the number of vertex groups belonging to the cluster 
clustl stores the number of vertex groups belonging 
to the cluster clustl, i.e., 1. Specifically, the 
10 vertex group ID column 636 for vertex groups belonging 

to the cluster clustl stores the vertex group ID 0« 

A transforming operation for clusters in a 
three-dimensional object is carried out according to 
the animation data 700 shown in Figs. 7A and 7B. The 
1$ animation data 700 includes animation data 700A (in 

Fig- 7A) defining the number of clusters and the number 
of frames, and animation data 700B (in Fig. 7B) defining 
the amount of parallel movement of each cluster moving 
in each frame display period from the starting of the 
20 transformation to the end thereof . 

in Fig- 7A, the number of moving clusters is stored 
in the column 710 for the number of clusters in the 
animation data 7 00A. It is 2 in the example in Fig. 
7A- The number of frame display periods from the 
25 starting of the transformation to the end thereof is 

stored in the frame number column 720. It is 10 in 
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the example in Fig- 7A- Subsequently, in response to 
the number of moving clusters, 2, the respective 
amounts of parallel movement of the clusters in each 
frame display period are defined in every two 
5 consecutive rovs of the animation data 700B (in Fig. 

7B) - The cluster index (index) column 730 stores the 
.indexes of moving clusters. The column 740 for the 
amount of parallel movement (x, y, z) stores the amount 
of parallel movement from a reference posture - 
10 The amount of parallel movement of cluster clustO 

in frame 0 is (0, 0, 0). The amount of parallel movement 
of cluster clustl is also (0/ 0, 0). These indicate 
that the state is identical to the reference posture. 
The amount of parallel movement of cluster clustO in 
15 frame 1 is (1, 0, 0). On the other hand, the amount 

of parallel movement of cluster clustl is (~1, 0,0). 
Such data continue up to frame 9. The amount of 
parallel movement of cluster clustO in frame B is (lo, 
5, 1). On the other hand, the amount of parallel 
20 movement of cluster clustl is (-12, 0, 0). 

In cluster transformations including such 
operations as rotation, enlargement /reduction, 
shearing, and the like, it has been necessary for the 
operations to be carried out in conformity to a 
25 predetermined order- In the present invention, 

however f transformations can be carried out by cluster 
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operations independent of orders since both the 
reference position and moving amount of clusters are 
restricted to parallel movement . Also, the amount of 
arithmetic operations used is much lower than that in 
5 cluster transformations including rotation, 

enlargement/reduction, shearing, and the like. 

In the case of fine transformations for effecting 
facial or muscular expressions , changes in expressions 
and the like can fully be . represented even vhen the 
10 transformations are restricted to parallel movement- 

While the animation data 7 00 is usually made by human 
hands, the labor of making the animation data 7 00 will 
not differ from that in cluster transformations 
including rotation and the like even if the cluster 
15 transformations are restricted to parallel movement* 

Data such as those mentioned above are employed 
in this embodiment . Before explaining the processing 
of the program in this embodiment, the principle of 
an operation will be explained with reference to Figs . 
20 8A, SB, and BC. 

Fig. 8 A shows the state before moving a cluster. 
Pig . 8A shows positions of vertexes constructing a lip . 
in this example, the lip is constructed by vertexes 
arranged at thirteen positions VI, V2, V3, V4, V5, V6, 
25 V7, V8, V9, V10, vil, V12 and V13. In this example, 

the Lower lip is constructed by each vertex of group 
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o. The positions of each vertexes vtxO, vtxl, vtx2, 
vtx3, ytx4, and vtx5 before moving thereof, by which 
the lower lip is constructed, are the positions VI , 
V2, V3, V4 and VS respectively. The weights of the 
5 vertexes vtxO and vtx5 are 0.5 and the weights of 

vertexes vtxl, vtx2, vtx3 and vtx4 are 1.0. (See Fig. 

Assuming that the lower lip is moved downward 
so as to express his face expression that the human 
10 shaped character is opening his mouth, for example, 

clustO belong to the vertex groupO is moved downward 
in parallel. 

Fig. 8B shows a shape of a lip in the case that 
clusto shown in. Fig. 9A is moved downward without 
15 applying the process of the present embodiment thereto . 

In this example, each vertex included in c lust o is moved 
by the same moving amount as that, of clustO, In this 
case, all of the vertexes VtxO, vtxl, vtx2, vtx3 , vtx4 
and vtx5 of the lower lip after the parallel movement 
20 of clustO, are moved in parallel by the same amount 

of movement and they are moved to positions Via, V2a, 
V3a, V4a, V5a and V6a. In this case, the shape of the 
lip becomes angular (an outline of the lip has an angle 
near to a right angle) and therefore, it has unnatural 
25 shape as a human skin. 

Pig. 8C shows a shape of a lip in the case that 
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clustO shown in Fig. 8A is moved downward by applying 
the process of the present embodiment thereto, in the 
case that the process according to the present 
invention is applied, each of the vertexes vto, vtxl f 

5 vtx2, vtx3, vtx4 and vtxS constructing the lower lip 

is moved downward in parallel by the amount of movement 
according to the its respective weight, in this 
example, the weights of vtxO and vtx5 are 0.5, and the 
weights of the other vertexes vtxl , vtx2 , vtx3 and vtx4 

10 are 1.0. Accordingly , the amounts of movements of 

vertexes vtxO, vtx5 is one half (50%) of those of clustO . 
The amounts of movements of vertexes vtxl, vtx2, vtx3 
and vt.x 4 is the same(100%) as that of clustO. 

Accordingly, by the movement of clustO downward, 

15 vtxO and vtx5 with weights of 0 - 5 are moved to positions 

vib and V6b, which are higher than positions Via and 
V6a as shown in Fig. 8B. While vertexes vtxl, vtx2 , 
vtx3 and vtx 4 with weights of 1.0 are moved to the 
same positions V2b, V3b, V4b and V5b as those 

20 corresponding positions (V2a f V3a, V4a, andV5a) shown 

in Fig.8B, 

Although in Fig. BA, the positions of vertexes 
vtxO, vtxS and vertexes vtx2, vtx3 have substantially 
the same vertical position ( as represented by positions 
25 VI, v3, V4, and V6), after their movement according 

to this embodiment of the present invention, they thus 
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show greater deviation from such a common vertical 
position - That is r vertexes vtxo and vtxS show asmaller 
amounts of movement than that exhibited by the other 
vertexes and therefore the lip in Pig. BChas a round 
S shape in comparison with that shown in Fig- 8B . 

Accordingly, it is possible to express a natural shape 
of the lip when the human opens his mputh* 

Fig. 8B shows a case where the cluster C of Fig. 
8A is moved down in parallel. Here, the parallel 
10 movement is made with the vertexes VI and V6 having 

a weight of not 0.5 but 1.0. Namely, all the vertexes 
belonging to the cluster C have the same weight. The 
respective positions of vertexes via to V6a have moved 
down simply and equally from their corresponding 
15 positions shown in Pig. 8a. 

As in the foregoing, when moving each cluster 
in parallel, the amount of movement is changed by use 
of weights predefined for vertexes. 

In view of the principle of operation explained 
20 in the foregoing , a processing flow of an object 

transforming operation in this embodiment will be 
explained with reference to Figs. 9 to 11. 

Upon startup, according to the operating system 
stored in the ROM 104 and the like, the CPU 103 reads 
25 out the game program 133 and data 135 necessary for 

executing image processing and games from the CD-ROM 
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131 via the CD-ROM 113/ and transfers them to the RAM 
105, Then, by executing the game program 133 
transferred to the RAM 105, the CPU 103 realizes the 
processing set forth in the following description. 

5 Here, the control and processing operations 

performed in the home game machine 101 include those 
in which actual control and processing operations are 
carried out by circuits other than the CPU 103 in 
cooperation with the CPU 103. For convenience of 

10 explanation, however', the control and processing 

operations involving the CPU 103 will be explained in 
the following as being directly executed by the CPU 
103. 

In practice, the game program 133 and data 13S 
IS necessary for executing the image processing and games 

are sequentially read out from the cp-ROM 131 and 
transferred to the RAM 105 according to the progress 
of the processing under the command of the CPU 103. 
However, for easier understanding of the invention/ 
20 the readout from the CD-ROM 131 and transfer to the 

RAM 105 will not be described in the following 
explanation. 

If the game program 133 and data 135 necessary 
for executing the image processing and games are stored 
25 in the HDD 107 r then they will sequentially be read 

out from the HDD 107 and transferred to the RAM 105 
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according to the progress of the processing under the 
command of the CPU 103- However, for a reason similar 
to that mentioned above, the readout from the HDD 107 
and transfer to the RAM 105 will not be described in 
5 the following explanation. 

Pig. 9 shows a main flow in accordance with this 
embodiment- First, an initial setting is effected 
(step SI) . In this initial setting, data such as those 
shown in Figs . 2 to 7 are loaded into the RAM 105 . Also , 
10 the frame counter 900 is reset to 0. Subsequently, 

a state within a virtual space is set (step S3). 
Setting a state within a virtual space is a process 
in which, for example, when animation of a 
three-dimensional object is instructed to start upon 
15 a user's manipulation of the keypad 161 or when a 

viewpoint position is changed similarly upon a user's 
manipulation of the keypad 161, the state in the virtual 
space is changed accordingly. 

Then, an object transforming process in 
20 accordance with the present invention is carried out 

(step S5), This will be set forth later in detail. 
The transformed three-dimensional object is subjected 
to a drawing process (step S7). Here, light-source 
calculation, perspective transformation, and the like 
25 are carried out so as to draw a picture of the three 

dimensional object in the frame buffer 112 , in the 
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drawing process with respect to the three-dimensional 
object. In this embodiment f the drawing process does 
not differ from a conventional one. Subsequently, an 
increment of 1 is added to the frame counter 900 (step 
5 S9). Then, it is determined whether the processing 

is completed or not (step Sll) - If the value of the 
frawe counter 900 indicates the completion of the 
processing , then the operation is terminated, if the 
value of the frame counter 900 does not indicate the 
10 completion of the processing, then the operation 

returns to step S3. 

Pig. 10 shows a flow of the object transforming 
process- First, an original form of the 
three-dimensional object is acquired (step S21). 
15 Here, the vertex coordinate list 200 copied to the RAM 

105 is copied/ so as to generate the vertex buffer 800 . 
Subsequently, a cluster transforming process in 
accordance with the present invention is carried out 
(step S23). This cluster transforming process will 
20 be set forth later in detail. Then, a joint 

transforming process is carried out (step S25)* 
Thereafter, the operation shifts to step S7 in Fig. 
9. 

The joint transforming process is performed as 
25 follows. For example, in the case where a 

three-dimensional object of a human model is to be 
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transformed, joints corresponding to human joints are 
defined , Individual vertexes determining the form of 
the three-dimensional object are associated with each 
joint together with their relative positions from the 
joint. Also, the joints are connected to each other 
by bones corresponding to human bones , while each joint 
rotates such that the bones rotate about joint portions . 
As the joint rotates, the positional coordinates of 
vertexes and normal vectors associated with the joint 
are changed, whereby a relatively large transforming 
process corresponding to movements of human bones is 
effected. 

One characteristic feature of the present 
invention lies in that the cluster transforming process 
is carried out before the joint transforming process. 
According to this order, large transformations are 
effected after fine transformations of the 
three-dimensional object are carried out. For 
example, if the processing is effected in this order 
in the case of opening the mouth of a three-dimensional 
object of a human model and bending its neck, the neck . 
will be bent after the lower lip portion is moved 
directly downward. Here, the operation of opening the 
mouth and the operation of moving the lower lip portion 
directly downward correspond to each other one to one . 
If this order is reversed, however, the mouth will open 
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after the neck is bent. When the neck is bent, the 
mouth will not open in a natural form even if the lower 
lip portion is moved directly downward. Therefore, 
the lower lip portion has to be moved while taking 

5 account of how the neck bends. Hence, the processing 

flow of Fig. 10 simplifies the whole operation - 

Fig. 11 shows details of the cluster transforming 
process. First, it is determined whether the 
transforming process has been carried out for all the 

10 clusters or not (step S31). If the transforming 

process has been carried out for all the clusters , then 
the operation shifts to step 525 in Fig- 10. If the 
transforming process has not been completed for all 
the clusters, then the operation shifts to step S33. 

15 At this stage, it is assumed that the frame display 

period being processed can be seen from the value of 
the frame counter 900. 

At step S33, a cluster index is acquired from 
the animation data 700 (step S33) . Then, the amount 

20 of parallel movement (Tx, Ty, T2) concerning this 

acquired cluster index is obtained ( step S35 ) , in the 
animation data 700, the order of clusters being 
processed does not matter as long as their frame display 
period is the same* Because of this fact the 

25 transformation is limited to parallel movement. 

Subsequently , it is determined whether the moving 
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process has been completed for all the vertex groups 
associated with the acquired cluster index ( step S37 } . 
If the moving process has been completed for all the 
vertex groups associated with the acquired cluster 
index, then the operation returns to step S31 in order 
to shift to the processing of the next cluster index. 
If the moving process has not been completed for all 
the vertex groups associated with the acquired cluster 
index, then an unprocessed vertex group ID is acquired 
from the cluster data 600. 

Then, the vertex group list 500 is referred to, 
so as to determine whether the moving process has been 
completed for all the vertexes belonging to the 
acquired vertex group ID or not ( step S41 ) . The vertex 
group list 500 includes no information concerning the 
vertex group ID- However , the vertex group list 50 0 
can be scanned from the top, so as to grasp the vertex 
group ID according to the number of occurrences of rows 
52 0 to 524 indicating their respective numbers of 
vertexes. Namely, since the number of occurrences of 
vertex number rows 520 to 524 minus 1 indicates the 
vertex group ID/ vertex information concerning the 
acquired vertex group ID can be obtained if the vertex 
group list 500 is scanned from the top until the number 
of occurrences of vertex number rows 520 to S24 minus 
1 equals the acquired vertex group ID. 



31 



MPY-30-2002 12:06 



BEYER UIERUER & THOMAS 



8961 8301 P. 43/71 
1103-00 



If the moving process has been completed for all 
the vertexes belonging to the acquired vertex group 
ID, then the operation returns to step S.37. If the 
moving process has not been completed for all the 

5 vertexes belonging to the acquired vertex group ID, 

then an unprocessed vertex index is acquired from the 
vertex group list 500, and the weight w (which is a 
real number of at least 0 but not greater than 1) of 
the vertex is similarly acquired from the vertex group 
10 list 500 (step $43) - 

Then, according to the amount of parallel 
movement (Tx, Ty, Tz) in this frame display period and 
the weight v, the coordinate information in the vertex 
buffer 800 is changed (step S45) . Namely, new 

15 coordinates (nx, ny, nz) in the case where the 

coordinates of the vertex being processed are assumed 
to be (x, y, z) are calculated according to the following 
expression: 

nz- x + 2xxw 

ny«y + 7>xw (1) 

20 The resulting new coordinates (nx, ny, nz) are 

stored in the vertex buffer 8 00. 

Thus, the value of coordinates of the vertex is 
updated- The updated vertex coordinates are stored 
in the vertex buffer 800, and a three-dimensional 
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object is dr awn in the frame buffer 112 according to 

the contents of the vertex buffer. 

After the step S45, the opexation returns to the 

step S41, and then steps S 43 and S45 are carried out 

until the moving process is completed for all the 
vertexes in the vertex group. 

In the cluster transforming process, the process 
of transforming normal vectors may be omitted. Though 
recalculation is necessary to be exact, the resulting 
image quality will not differ in the. case of fine 
transformations even without recalculating normal 
vectors „ 

As mentioned in the foregoing, when a 
three-dimensional object whose form is determined by 
a plurality of vertexes each associated with at least 
one cluster is to be transformed, the amount of parallel 
movement of each cluster is acquired in each frame 
display period < step S35 ) . Then, in each frame display 
period, the amount of parallel movement of each 
acquired cluster is changed per each vertex 
corresponding to the cluster according to the weight 
predefined for the vertex, and the vertex is moV ed 
according to this changed amount of parallel movement 
(step S45) . 

The vertex moves by the amount of parallel 
movement in which the amount of parallel movement of 
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defiD " Wh - «• -te„ corresponds to 

a plurality „ cl?sters< then ^ . s ^ ^ ^ 

order of 0 p eration , ^ ^ ^ ^ ^ ^ 
parallel _„t i. carrled .„ a pluMllty ^ 
Also. tb. parallel movene „ t c£ t|)e vertej( cm ^ 

the M or arithmetic operas, is lover ^ 
in the case of rotary moveBent vh . ch „ ecessltstes 
matrix operations. 

»«=iy, if th. movement OI „ rtcj[es beionsi 

« a duster is restricted t. parallel movemant alone 
then it becomes unn.cessary to t a) c. a « onnt of t „. order 
Of transform^ operations, and .ul tlt>lleatloil ^ 
addition win SH£fice vitho „ t nece , si „ t . n9 matrix 

operations, since no matri, operations are carried 

out, the amount of processing ^re- 
processing decreases, thereby 

facilltatin, the real-time proo.ssin, o, fine 
*0 transformations or . turee-dim. n . l0I , al objeet _ Jh> 
Present invention is particularly effective in the case 
where tne three-dimension.! object has a l arge nuBber 
of vertexes. 

Aisc. since the object transformation is carried 
* out in the order of the cluster transform, process 
«« the joint transforming process as shown tn the 
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object transforming process of Fig. 10, the cluster 
transformation can be formulated, whereby the 
processing becomes simpler as a whole. 
(Display Example) 

Pig. 12 shows a polygon model of a 
three-dimensional object 10 before a transformation. 
Fig . 12 shows the head of the three-dimensional object 
10 of a human model as viewed from the front side. The 
head is a part to which particular attention is paid, 
and it can be seen that the head is constituted by a 
number of polygons. In particular, in order to 
represent an abundance of expressions by minute 
movements, the eye and mouth parts in the head are 
constituted by a very large number of polygons. For 
a transformation of opening the mouth, it will not be 
sufficient if the cluster of the lower lip portion is 
moved down alone, but a transformation is effected such 
that a plurality of clusters are moved in parallel, 
so as to open the mouth in a more natural form. 

Fig. 13 shows a polygon model of a 
three-dimensional object 12 after the transformation . 
Fig. 13 is identical to Fig. 12 in that the head of 
the three-dimensional object 12 of a human model is 
shown therein, but differs therefrom in that the 
posture of the three-dimensional object is changed, 
and that the mouth is open. The posture .of the 
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three-dimensional object is changed in the joint 
transforming process (Fig. io ; step S25). m the 
present invention, the cluster transforming process 
( step S23 ) f or opening th . . g ^ . ^ ^ ^ ^ 

the joint transforming process. inFig. 13, clusters 
are provided in a portion extending from the lower lip 
to the lower jaw, and are moved downward . Also, minute 
transformations such as those of laterally moving 
clusters disposed at cheek portions are implemented. 

Fig- 14 shows an example of a display screen in 
which the three-dimensional object 10 shown in Fig. 

12 is drawn, it can be seen that, though the method 
of drawing is identical to a conventional one, a 
smoother three-dimensional object is drawn, on the 
other hand, Fig. is shows an example of d ispl a y SCre en 
in which the three-dimensional object 12 shown in Fig. 

13 is drawn, it can be seen that, while a 
transformation of opening the mouth is effected in the 
three-dimensional object 10 in accordance w ith the 
Present invention, the smooth three-dimensional 
object 12 is drawn with its mouth being open in a natural 
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The following modifications are applicable to 
the above embodiments. 
25 (Modification 1) 

The animation data 70 0 is provided on the premise 
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that data concerning the amount of parallel movement 
for all the frames are stored therein. However, it 
is not always necessary for data concerning the amount 
of parallel movement for all the frames to be stored 
therein. The amount of parallel movement for a frame 
lacking data can be determined by an interpolation 
between the respective amounts of parallel movement 
in its preceding and succeeding frames. That is, it 
is initially determined whether the amount of parallel 
movemenr of each cluster in each frame display period 
is defined or not. if it is determined tft „ ^ 
of parallel movement of each cluster in the frame 
display period being processed is not defined, then 
the a m ount of parallel movement of each cluster at the 
frame display period being processed is calculated from 
the amount of parallel movement of each cluster in a 
frame display period which has already been processed 
and the amount of parallel movement of each cluster 
in a frame display period to be processed later, if 
it is determined that the amount of parallel movement 
of each cluster i„ the frame display period being 
processed is defined, on the other hand, then the 
defined amount of parallel movement of each cluster 
in the frame display period being processed is 
acguired. 

(Modification 2) 
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Though th. above-^ntioned embodiment has been 
expiated on the basis « a „ Iasolir polygon , ^ 
Present invention is also applicable to models in which 
• three-dimensional object ia tranced by movie, 
-rt.xes even in rectangular or other polygons having 
more sides. 

(Modification 3) 

Modification of Employed Hardware 

1 is an example, in which various 
Edifications are po ssible . Whether or ^ ^ 

the communications interface 115 is arbitrary. £ince 
the present invention does not directly relate to sound 
processing it is not necesgary ^ ^ ^ 

processing unit 109, 

Also , the Cb-ROK is an e „ mpu at re=ordina . a 
whereas other recording media each as an i, tarnal 
».»ory like *o„, cd-rom. DVD . R0 „, KmBI , c , rtridge 
"oppy nagnatic d . sk; DVD-ram, and the li k e can 

9lSO US ' d - In " » necessary that the 

CD-RC drive U3 be replaced by a drive which can read 
out the corresponding medium. 

Though the foregoing relates to the case where 
the present invention is implemented by a computer 
P»,ram, it can also be implement.d by a combination 
o£ a computer program and a dedicated device such as 
an electronic circuit, or a dedicated device such as 
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an electronic circuit alone. 

Though explained in detail with reference to 
embodiments in the foregoing, the present invention 
is not restricted to the above-mentioned embbdiments . 
It can be modified within the scope nor deviating from 
the gist thereof. For example, though the 
above-mentioned embodiments relate to the case where 
the present invention is realized while using a home 
game machine as a platform, the present invention may 
also be realized while using a normal computer, an 
arcade gamemachine, or the like as its platform. A i so , 
the present invention may be realized while using a 
personal digital assistant, a car navigation system, 
or the like as its platform. 

Also, the program and data for realizing the 
present invention are not restricted to the mode 
provided by a recording medium mountable /removable 
with respect to computers, game machines, and the like, 
such as CD-ROM. Namely, the program and data for' 
realizing the present invention may also be in such 
a mode that they are recorded in memories of other 
devices on the network 151 connected to the game machine 
or the like by way of the communications interface lis 
and the communications line 141, and are used as being 
successively stored into the RAM 105 by way of the 
communications line 141 as required. 
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As explained in the foregoing, the present 
invention can provide a technique which realizes fine 
transformations of three-dimensional objects by a 
simple process. 

From the invention thus described, it will be 
obvious thet the embodiments of the invention may be 
varied in many ways. 5uch variatlol>s are ^ ^ ^ 
regarded as a departure from the spirit and scope of 
the invention, and all such modifications as „ ould be 
obvioos to one skilled in nh. art are intended £or 
inclusion within the scope o f the f ollowi„ 3 claims 
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